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EXAMINER'S ANSWER 



This is in response to the appeal brief filed April 18, 2006 appealing from the 
Office action mailed July 15, 2005. 
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(1) Real Party in Interest 

A statement identifying by name the real party in interest is contained in 
the brief. 

(2) Related Appeals and Interferences 

The examiner is not aware of any related appeals, interferences, or 
judicial proceedings which will directly affect or be directly affected by or have a 
bearing on the Board's decision in the pending appeal. 

(3) Status of Claims 

The statement of the status of claims contained in the brief is correct. 

(4) Status of Amendments After Final 

The appellant's statement of the status of amendments after final rejection 
contained in the brief is correct. 

(5) Summary of Claimed Subject Matter 

The summary of claimed subject matter contained in the brief is correct. 

(6) Grounds of Rejection to be Reviewed on Appeal 

The appellant's statement of the grounds of rejection to be reviewed on 
appeal is correct. 

(7) Claims Appendix 

The copy of the appealed claims contained in the Appendix to the brief is 
correct. 

(8) Evidence Relied Upon 

5,617,141 Nishimura et al. 4-1997 
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5,550,587 



Miyadera 



8-1 996 



5,563,658 



Parulski et al 



10-1996 



6,757,020 



Kikuchi 



6-2004 



(9) Grounds of Rejection 

The following ground(s) of rejection are applicable to the appealed claims: 

A. Claims 1, 7, and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nishimura et al. (US Patent # 5,617,141). 

In regard to claim 1 , note Nishimura discloses the use of a method of 
simulating fill flash in a camera system comprising the steps of determining 
distances from the camera to objects in a scene (column 5, lines 22-27), taking a 
photograph of the scene (column 4, lines 60-65; although it is not explicitly stated 
that the photograph is taken without a flash, it is implied because nowhere in 
Nishimura is the use of a flash disclosed, and the distance is not determined 
using a flash), and selectively adjust the brightness of regions of the photograph 
based on the distance information (column 5, lines 33-48). Therefore, it can be 
seen that the Nishimura device fails to capture the image without using a flash. 
Official notice is taken that the concepts and advantages of taking a photograph 
of the scene without a flash are notoriously well known and expected in the art. 
Therefore, it would have been obvious to one of ordinary skill in the art to modify 
the Nishimura device to capture the image without a flash in order to capture an 
image in an area where the use of a flash would be inappropriate or 
unnecessary. 
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In regard to claim 7, note Nishimura discloses the use of a camera system 
for simulating fill flash in a camera system comprising determining distances from 
the camera to objects in a scene (column 5, lines 22-27), taking a photograph of 
the scene (column 4, lines 60-65; although it is not explicitly stated that the 
photograph is taken without a flash, it is implied because nowhere in Nishimura is 
the use of a flash disclosed, and the distance is not determined using a flash), 
and selectively adjust the brightness of regions of the photograph based on the 
distance information (column 5, lines 33-48). Therefore, it can be seen that the 
Nishimura device fails to capture the image without using a flash. Official notice 
is taken that the concepts and advantages of using a camera without a flash to 
capture an image are notoriously well known and expected in the art. Therefore, 
it would have been obvious to one of ordinary skill in the art to modify the 
Nishimura device to capture the image without a flash in order to capture an 
image in an area where the use of a flash would be inappropriate or 
unnecessary. 

In regard to claim 14, note Nishimura discloses the use of a camera for 
simulating fill flash in a camera system comprising determining distances from 
the camera to objects in a scene (column 5, lines 22-27), taking a photograph of 
the scene (column 4, lines 60-65; although it is not explicitly stated that the 
photograph is taken without a flash, it is implied because nowhere in Nishimura is 
the use of a flash disclosed, and the distance is not determined using a flash), 
and selectively adjust the brightness of regions of the photograph based on the 
distance information (column 5, lines 33-48). Therefore, it can be seen that the 
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Nishimura device fails to capture the image without using a flash. Official notice 
is taken that the concepts and advantages of using a camera without a flash to 
capture an image are notoriously well known and expected in the art. Therefore, 
it would have been obvious to one of ordinary skill in the art to modify the 
Nishimura device to capture the image without a flash in order to capture an 
image in an area where the use of a flash would be inappropriate or 
unnecessary. 

B. Claims 2-4, 8-11, and 23-24 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Nishimura et al. (US Patent # 5,617,141) in view of 
Parulski et al (US Patent # 5,563,658). 

In regard to claim 2, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 1 . Therefore, it can 
be seen that the Nishimura reference fails to disclose the taking of a series of 
photographs with the camera configured to focus on objects at various distances 
from the camera and analyzing the series of photographs and corresponding 
focus distances. Parulski discloses the taking of a series of photographs with the 
camera configured to focus on objects at various distances from the camera 
(column 6, lines 5-17; the camera continuously captures images until the focus is 
acquired) and analyzing the series of photographs and corresponding focus 
distances (column 6, lines 5-17; the camera is continually analyzing the images 
until an image is acquired in focus). Parulski teaches that the taking of a series 
of photographs with the camera configured to focus on objects at various 
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distances from the camera and analyzing the series of photographs and 
corresponding focus distances is preferred in order to decrease the amount of 
time it takes to focus the camera (column 2, lines 25-31 ). For that reason, it 
would have been obvious to one of ordinary skill in the art to modify the 
Nishimura device to include the taking of a series of photographs with the 
camera configured to focus on objects at various distances from the camera, 
storing said photographs along with a focus distance for each photograph, and 
analyzing the series of photographs and corresponding focus distances as 
suggested by Parulski. 

In regard to claim 3, note Parulski discloses the computing of the contrast 
in the image (column 6, lines 5-17). 

In regard to claim 4, note Parulski discloses that the step of determining 
the distances to objects at locations in the scene further comprises locating the 
particular photograph in the series of photographs with the spatial contrast metric 
indicating that objects at that location in the scene are more nearly in focus in 
that particular photograph than in any other in the series of photographs (column 
6, lines 5-17; the camera is continually analyzing the images until an image is 
acquired that is the best possible focused image by increasing or decreasing the 
lens focus position based on contrast the level; the photograph having the 
average contrast increase is more nearly in focus than other photographs in the 
series of photographs) and identifying the distance from the camera to objects at 
that location in the scene as the focus distance stored in connection with that 
particular photograph (column 6, lines 5-17; using the Nishimura step of 
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identifying distances from the camera to an object along with the storage of the 
average value in Parulski one of ordinary skill in the art would be motivated to 
combine the two in order to identify and store the distance). 

In regard to claim 8, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 7 as well as the 
determination of distances from the camera to an object (column 5, lines 22-27). 
Therefore, it can be seen that the Nishimura reference fails to disclose the taking 
of a series of photographs with the camera configured to focus on objects at 
various distances from the camera and analyzing the series of photographs and 
corresponding focus distances to determine the object distances. Parulski 
discloses the taking of a series of photographs with the camera configured to 
focus on objects at various distances from the camera (column 6, lines 5-17; the 
camera continuously captures images until the focus is acquired) and analyzing 
the series of photographs and corresponding focus distances to determine the 
object distances (column 6, lines 5-17; using the method of Nishimura of 
calculating the distance from the camera to objects and combining it with the 
Parulski process of analyzing images one object along with the process of 
analyzing images in Parulski one of ordinary skill in the art would be motivated to 
combine the two in order to focus the camera on the proper object). Parulski 
teaches that the taking of a series of photographs with the camera configured to 
focus on objects at various distances from the camera and analyzing the series 
of photographs and corresponding focus distances to determine the object 
distances is preferred in order to decrease the amount of time it takes to focus 
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the camera (column 2, lines 25-31). Therefore, it would have been obvious to 
one of ordinary skill in the art to modify the Nishimura device to include the taking 
of a series of photographs with the camera configured to focus on objects at 
various distances from the camera, storing said photographs along with a focus 
distance for each photograph, and analyzing the series of photographs and 
corresponding focus distances to determine the object distances as suggested 
by Parulski. 

In regard to claim 9 t note the primary reference of Nishimura in view of 
Parulski discloses the use of a camera system which simulates fill flash by 
determining distances from the camera as claimed in claim 8. Therefore, it can 
be seen that the primary device lacks a computer separate from the camera and 
wherein the series of trial photographs and their focus distances are transmitted 
to the separate computer for analysis and the simulation of fill flash. Official 
notice is taken that the concepts and advantages of the transfer of image data 
along with additional information from a camera to an external computer for 
further processing is notoriously well known and expected in the art. Therefore, it 
would have been obvious to one of ordinary skill in the art to modify the primary 
device taught in Nishimura and Parulski to include the use of a computer 
separate from the camera, and wherein the series of trial photographs and their 
focus distances are transmitted to the separate computer for analysis and the 
simulation of fill flash in order to edit the images for printing and storage. 

In regard to claim 10, note Parulski discloses the computing of the 
contrast in the image (column 6, lines 5-17). 
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In regard to claim 1 1 , note Parulski discloses locating the particular 
photograph in the series of photographs with the spatial contrast metric indicating 
that objects at that location in the scene are more nearly in focus in that particular 
photograph than in any other in the series of photographs (column 6, lines 5-17; 
the camera is continually analyzing the images until an image is acquired that is 
the best possible focused image by increasing or decreasing the lens focus 
position based on contrast the level; the photograph having the average contrast 
increase is more nearly in focus than other photographs in the series of 
photographs) and identifying the distance from the camera to objects at that 
location in the scene as the camera focus distance stored in connection with that 
particular photograph (column 6, lines 5-17; using the Nishimura step of 
identifying distances from the camera to an object along with the storage of the 
average value in Parulski one of ordinary skill in the art would be motivated to 
combine the two in order to identify and store the distance). 

In regard to claim 23, note Parulski discloses the selection of one image 
from a series of photographs taken in determining the distances from the camera 
to objects in the scene (column 6, lines 5-17; the camera continuously captures 
images until the focus is acquired, therefore, the selected image is the image 
with the maximum average contrast). Nishimura discloses that the use of the 
selected photograph (taken from Parulski) is used as the photograph in which the 
brightness of regions is selectively adjusted (column 5, lines 52-57, by using the 
selected image from Parulski, then Nishimura selectively adjusts the brightness 
of the regions in the image). 
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In regard to claim 24, note Parulski discloses the selection of one image 
from a series of photographs taken in determining the distances from the camera 
to objects in the scene (column 6, lines 5-17; the camera continuously captures 
images until the focus is acquired, therefore, the selected image is the image 
with the maximum average contrast). Nishimura discloses that the use of the 
selected photograph (taken from Parulski) is used as the photograph in which the 
brightness of regions is selectively adjusted (column 5, lines 52-57, by using the 
selected image from Parulski, then Nishimura selectively adjusts the brightness 
of the regions in the image). 

C. Claims 5-6 and 12-13 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nishimura et al. (US Patent # 5,617,141) in view of 
Miyadera (US Patent # 5,550,587). 

In regard to claim 5, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 1. Therefore, it can 
be seen that the Nishimura reference fails to disclose that the regions containing 
objects closer to the camera are lightened in the resulting photograph in relation 
to regions containing objects farther from the camera. Miyadera discloses that 
the regions containing objects closer to the camera are lightened in the resulting 
photograph in relation to regions containing objects farther from the camera 
(column 7, lines 61-64 and column 8, lines 3-12). Miyadera teaches that the 
lightening of objects that are closer is preferred so that objects at a short distance 
are reproduced in proper color corresponding to the long distance (column 1, 
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lines 35-40). For that reason, it would have been obvious to one of ordinary skill 
in the art to modify the Nishimura device to include the lightening of objects that 
are closer as suggested by Miyadera. 

In regard to claim 6, note the primary reference of Nishimura in view of 
Miyadera discloses the use of a method of simulating fill flash in a camera 
system as claimed in claim 5. Therefore, it can be seen that the Nishimura in 
view of Miyadera device fails to modify the brightness of regions in the resulting 
photograph in accordance with the inverse square law. Official notice is taken 
that the concepts and advantages of brightening an image in accordance with the 
inverse square law are notoriously well known in the art. Therefore, it would 
have been obvious to one of ordinary skill in the art to modify the primary device 
taught in Nishimura and Miyadera to include the use of brightening the image in 
accordance with the inverse square law in order to compensate for the degraded 
image quality due to the effects of the inverse square law. 

In regard to claim 12, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 7. Therefore, it can 
be seen that the Nishimura reference fails to disclose that the regions containing 
objects closer to the camera are lightened in the resulting photograph in relation 
to regions containing objects farther from the camera. Miyadera discloses that 
the regions containing objects closer to the camera are lightened in the resulting 
photograph in relation to regions containing objects farther from the camera 
(column 7, lines 61-64 and column 8, lines 3-12). Miyadera teaches that the 
lightening of objects that are closer is preferred so that objects at a short distance 
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are reproduced in proper color corresponding to the long distance (column 1 , 
lines 35-40). For that reason, it would have been obvious to one of ordinary skill 
in the art to modify the Nishimura device to include the lightening of objects that 
are closer as suggested by Miyadera. 

In regard to claim 13, note the primary reference of Nishimura in view of 
Miyadera discloses the use of a camera system which simulates fill flash by 
determining distances from the camera as claimed in claim 12. Therefore, it can 
be seen that the Nishimura in view of Miyadera device fails to modify the 
brightness of regions in the resulting photograph in accordance with the inverse 
square law. Official notice is taken that the concepts and advantages of 
brightening an image in accordance with the inverse square law are notoriously 
well known in the art. Therefore, it would have been obvious to one of ordinary 
skill in the art to modify the primary device taught in Nishimura and Miyadera to 
include the use of brightening the image in accordance with the inverse square 
law in order to compensate for the degraded image quality due to the effects of 
the inverse square law. 

D. Claims 15-22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nishimura et al. (US Patent # 5,617,141) in view of 
Kikuchi (US Patent # 6,757,020). 

In regard to claim 15, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 1. Therefore, it can 
be seen that the Nishimura device lacks the use of varying the amount of 
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brightness adjustment in response to a user control. Kikuchi discloses the use of 
varying the amount of brightness adjustment in response to a user control 
(column 1 , lines 27-32). Kikuchi teaches that the use of a user adjustable 
brightness value is preferred in order to properly capture an image that is desired 
by the user (column 1 , lines 30-37). For that reason, it would have been obvious 
to one of ordinary skill in the art to modify the Nishimura device to include varying 
the amount of brightness adjustment in response to a user control as suggested 
by Kikuchi. 

In regard to claim 16, note Kikuchi discloses that the user control is 
comprised in the camera (column 1, lines 48-54; and figure 1:64). 

In regard to claim 17, note Kikuchi discloses the display of the effect of 
brightness adjustment on the display (column 1, lines 27-37). 

In regard to claim 18, note Kikuchi discloses that the display is comprised 
in the camera (column 1 , lines 48-54; and figure 1 :44). 

In regard to claim 19, note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 7. Therefore, it can 
be seen that the Nishimura device lacks the use of varying the amount of 
brightness adjustment in response to a user control. Kikuchi discloses the use of 
varying the amount of brightness adjustment in response to a user control 
(column 1 , lines 27-32). Kikuchi teaches that the use of a user adjustable 
brightness value is preferred in order to properly capture an image that is desired 
by the user (column 1 , lines 30-37). For that reason, it would have been obvious 
to one of ordinary skill in the art to modify the Nishimura device to include varying 
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the amount of brightness adjustment in response to a user control as suggested 
by Kikuchi. 

In regard to claim 20, note Kikuchi discloses that the user control is 
comprised in the camera (column 1, lines 48-54; and figure 1: 64/66). 

In regard to claim 21 , note Nishimura discloses the use of a method of 
simulating fill flash in a camera system as claimed in claim 7. Therefore, it can 
be seen that the Nishimura device lacks the use displaying the effect of 
brightness adjustment on the display. Kikuchi discloses the displaying the effect 
of brightness adjustment on the display (column 1 , lines 27-37). Kikuchi teaches 
that the use of a user adjustable brightness value is preferred in order to properly 
capture an image that is desired by the user (column 1 , lines 30-37). For that 
reason, it would have been obvious to one of ordinary skill in the art to modify the 
Nishimura device to include displaying the effect of brightness adjustment on the 
display as suggested by Kikuchi. 

In regard to claim 22, note Kikuchi discloses that the display is comprised 
in the camera (column 1, lines 48-54; and figure 1:44). 

(10) Response to Argument 

1. With respect to claims 1, 7 and 14, Appellant argues that Nishimura et al. 
fails to meet the limitations of the claims. Specifically that Nishimura does not 
teach "selectively adjusting the brightness of regions of the photograph based on 
the distance information." The examiner disagrees, the Nishimura reference 
does selectively adjust the brightness of regions of the photograph. Since the 
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regions are not specifically defined in claims 1, 7 and 14, the examiner is 
interpreting this limitation to mean that the brightness is selectively adjusted 
based on distance information, and that the regions include the entire image. 
Therefore, in the Nishimura reference, the brightness of the "regions" (i.e. the 
entire image) is adjusted based on the distance information (column 5, lines 33- 
48). 

Applicant also argues that Nishimura uses a different "detection 
characteristic" to set exposure depending on scene "ambience". However, points 
out that the "ambience" is calculated by using object distance and object 
illumination (column 5, lines 33-47; and figure 4). Therefore, Nishimura meets 
the limitations of the claim because the image is adjusted based on the "region" 
selected (this region is not to be confused with an area of the image, but rather 
preset threshold levels of distance and illumination), and by using distance and 
illumination levels the correct exposure is selected. 

Applicant also argues that different regions of the photograph are not 
affected selectively by Nishimura. However, the examiner is interpreting the 
limitation of "selectively adjusting the brightness of regions of the photograph 
based on the distance information" to mean that the brightness is selectively 
adjusted based on distance information, and that the regions include the entire 
image. Therefore, in the Nishimura reference, the brightness of the "regions" (i.e. 
the entire image) is adjusted based on the distance information (column 5, lines 
33-48). 
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Applicant also argues that the "regions" depicted in Figure 4 are not 
regions of a photograph. The examiner agrees, Figure 4 has not been relied on 
as regions of an image, but does teach that the image is adjusted based on the 
"region" selected (this region is not to be confused with an area of the image, but 
rather preset threshold levels of distance and illumination), and by using distance 
and illumination levels the correct exposure is selected. 

Applicant also argues that Figure 4 is not a map of a scene or photograph. 
The examiner agrees, Figure 4 has not been relied on as a map of a scene or 
photograph, but does teach that the image is adjusted based on the "region" 
selected (this region is not to be confused with an area of the image, but rather 
preset threshold levels of distance and illumination), and by using distance and 
illumination levels the correct exposure is selected. 

Applicant also argues, that in Figure 4, a location in the "map" does not 
correspond to a particular location in a scene. The examiner agrees, Figure 4 
has not been relied on as a map of a scene or photograph, but does teach that 
the image is adjusted based on the "region" selected (this region is not to be 
confused with an area of the image, but rather preset threshold levels of distance 
and illumination), and by using distance and illumination levels the correct 
exposure is selected. 

2. Appellant argues that Nishimura and Parulski do not teach or suggest all 
of the limitations of Appellant's claims 2-4 and 23 as discussed with claims 1 , 7 
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and 14. The examiner disagrees for the same reason as set forth above for 
claims 1, 7 and 14. 

Appellant argues that Nishimura and Parulski do not teach or suggest all 
of the limitations of Appellant's claims 8-1 1 and 24 as discussed with claims 1 , 7 
and 14. The examiner disagrees for the same reason as set forth above for 
claims 1, 7 and 14. 

3. Appellant argues that Miyadera does not disclose, "adjusting the 
brightness of regions" because Miyadera is trying to preserve the brightness 
because the weightings of the gains "sum to unity", and that Miyadera is 
performing white balance under flash illumination. However, the examiner 
disagrees, the examiner points out that Miyadera does not disclose anything 
about preserving the brightness of the image, but rather that the color 
temperature is adjusted, although the weighting of the gains may sum to unity, 
the overall color temperature is adjusted (e.g. the red signal may be adjusted 
more than the other blue signal, which would change the color temperature). 
Therefore, the examiner is interpreting the adjustment of the color temperature 
as the equivalent of lightening or darkening the image (the lower the 
temperature, the darker the image, and the higher the temperature, the lighter 
the image). Miyadera discloses that the regions containing objects closer to the 
camera are lightened in the resulting photograph in relation to regions containing 
objects farther from the camera (column 7, lines 61-64 and column 8, lines 3-12). 
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And as for Miyadera performing white balance under flash illumination, the 
examiner points out that the white balance can be performed without using the 
flash (column 5, lines 44-50). 

Applicant also argues that Miyadera teaches away from applicant's 
method, and that the combination of Miyadera with other art in establishing 
obviousness is improper. The examiner disagrees, because Miyadera teaches 
the use of distance measurement to adjust an image. 

Applicant argues, with respect to claims 5-6 and 12-13, that "white 
balance adjustment is not the same as lightening regions in a photograph", and 
that "Miyadera endeavours to preserve brightness, not adjust it, and therefore 
does not describe a method in which regions containing objects closer to the 
camera are lightened in the resulting photograph in relation to regions containing 
objects farther from the camera." However, the examiner disagrees, the 
examiner points out that Miyadera does not disclose anything about preserving 
the brightness of the image, but rather that the color temperature is adjusted, 
although the weighting of the gains may sum to unity, the overall color 
temperature is adjusted (e.g. the red signal may be adjusted more than the other 
blue signal, which would change the color temperature). Therefore, the examiner 
is interpreting the adjustment of the color temperature as the equivalent of 
lightening or darkening the image (the lower the temperature, the darker the 
image, and the higher the temperature, the lighter the image). Miyadera 
discloses that the regions containing objects closer to the camera are lightened 
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in the resulting photograph in relation to regions containing objects farther from 
the camera (column 7, lines 61-64 and column 8, lines 3-12). 

Appellant argues that Nishimura and Miyadera do not teach or suggest all 
of the limitations of Appellant's claims 5-6 as discussed with claim 1 . The 
examiner disagrees for the same reason as set forth above for claim 1 . 

Appellant argues that Nishimura and Miyadera do not teach or suggest all 
of the limitations of Appellant's claims 12-13 as discussed with claim 7. The 
examiner disagrees for the same reason as set forth above for claim 7. 

4. Appellant argues that Nishimura and Kikuchi do not teach or suggest all of 
the limitations of Appellant's claims 15-18 as discussed with claim 1. The 
examiner disagrees for the same reason as set forth above for claim 1 . 

Appellant argues that Nishimura and Kikuchi do not teach or suggest all of 
the limitations of Appellant's claims 19-22 as discussed with claim 7. The 
examiner disagrees for the same reason as set forth above for claim 7. 

(11) Related Proceeding(s) Appendix 

No decision rendered by a court or the Board is identified by the examiner 
in the Related Appeals and Interferences section of this examiner's answer. 
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For the above reasons, it is believed that the rejections should be 



sustained. 



Respectfully submitted, / 

Chriss S. Yoder III r//fe 
Assistant Examine^T/ ^ 
Art Unit 2622 U 



Conferees: 

Ngoc-Yen Vu, SPE 
David Ometz, SPE 



